Learning Behaviors in Agents Systems with Interactive Dynamic Influence Diagrams
نویسندگان
چکیده
Interactive dynamic influence diagrams (I-DIDs) are a well recognized decision model that explicitly considers how multiagent interaction affects individual decision making. To predict behavior of other agents, I-DIDs require models of the other agents to be known ahead of time and manually encoded. This becomes a barrier to I-DID applications in a human-agent interaction setting, such as development of intelligent non-player characters (NPCs) in real-time strategy (RTS) games, where models of other agents or human players are often inaccessible to domain experts. In this paper, we use automatic techniques for learning behavior of other agents from replay data in RTS games. We propose a learning algorithm with improvement over existing work by building a full profile of agent behavior. This is the first time that data-driven learning techniques are embedded into the I-DID decision making framework. We evaluate the performance of our approach on two test cases.
منابع مشابه
Model identification in interactive influence diagrams using mutual information
Interactive influence diagrams (I-IDs) offer a transparent and intuitive representation for the decision-making problem in multiagent settings. They ascribe procedural models such as influence diagrams and I-IDs to model the behavior of other agents. Procedural models offer the benefit of understanding how others arrive at their behaviors. Accurate behavioral models of others facilitate optimal...
متن کاملApproximate solutions of interactive dynamic influence diagrams using ε-behavioral equivalence
Interactive dynamic influence diagrams (I-DID) are graphical models for sequential decision making in uncertain settings shared by other agents. Algorithms for solving I-DIDs face the challenge of an exponentially growing space of candidate models ascribed to other agents, over time. Pruning the behaviorally equivalent models is one way toward identifying a minimal model set. We seek to further...
متن کاملTeam behavior in interactive dynamic influence diagrams with applications to ad hoc teams
Planning for ad hoc teamwork is challenging because it involves agents collaborating without any prior coordination or communication. The focus is on principled methods for a single agent to cooperate with others. This motivates investigating the ad hoc teamwork problem in the context of individual decision making frameworks. However, individual decision making in multiagent settings faces the ...
متن کاملTowards Robust Model Identification in Interactive Influence Diagrams Using Mutual Information
Modeling the perceived behaviors of other agents improves the performance of an agent in multiagent interactions. We utilize the language of interactive influence diagrams to model repeated interactions between the agents, and ascribe procedural models to other agents. Procedural models offer the benefit of understanding how others arrive at their behaviors. As model spaces are often bounded, t...
متن کامل